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0 System comprising at least one encoder for coding a digital signal and at least one decoder for 
decoding a digital signal. 
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0 Known systems based on layered coding and 
decoding do not take account of the greater surface 
area of an HDTV picture, which is to be coded with 
high resolution, compared with the smaller surface 
area of a conventional picture, to be derived there- 
from, which is to be coded with low resolution. An 
improvement in the efficiency of the coding and 
decoding is achieved by actually taking account of 
this with the system according to the invention and 
maintaining the coupling between the two layers in 
the encoder and the decoder if a picture element is 
situated In a corresponding section of the two pic- 
tures and interrupting the coupling if a picture ele- 
ment is situated outside the corresponding section of 
the two pictures. 
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A Background of the invention 

The invention relates to a systenn comprising at 
least one encoder for coding a digital signal and at 
least one decoder for decoding a coded digital 
signal, which encoder is provided with 

- an input for receiving the digital signal, 

- first data processing naeans, coupled to the 
input, for generating a first coded digital sig- 
nal, 

- first encoder feedback means for feeding 
back at least a section of the first data pro- 
cessing means, which first encoder feedback 
means comprise first encoder memory 
means, 

- reduction means, coupled to the input, for 
reducing the received digital signal, 

- second data processing means, coupled to 
the reduction means, for generating a second 
coded digital signal, 

- second encoder feedback means for feeding 
back at least a section of the second data 
processing means, which second encoder 
feedback means comprise second encoder 
memory means, and 

- encoder coupling means for coupling the 
second encoder feedback means to the first 
encoder feedback means, which encoder 
coupling means comprise encoder prediction 
means, 

and which decoder is provided with 

- first data reprocessing means for processing 
a first coded digital signal, 

- first decoder memory means which are coup- 
led to the first data reprocessing means, 

- second data reprocessing means for process- 
ing a second coded digital signal, 

- second decoder memory means which are 
coupled to the second data reprocessing 
means, and 

- decoder coupling means for coupling the 
second decoder memory means to the first 
decoder memory means, which decoder cou- 
pling means comprise decoder prediction 
means. 

Such a system is known from "Coded repre- 
sentation of picture and audio information", "TMI 
Compatibility Experiments", by I. Parke, ISO- 
IEC/JTC1/SC29AWG11, MPEG92/291, in particular 
Figure 1 (the encoder) and Figure 2 (the decoder) 
thereof. The encoder based on layered coding 
comprises the input for receiving the digital signal 
to be coded, such as, for example, a television 
signal made up of picture elements (pixels or pels), 
and the first data processing means, coupled to the 
input, for generating the first coded digital signal 
(indicated by "T", "Q" in the abovementioned Fig- 
ure 1). The encoder furthermore comprises the first 



encoder feedback means for feeding back at least 
a section of the first data processing means in 
order to make the coding proceed more efficiently. 
The first encoder feedback means comprise the 

5 encoder memory means, and first encoder move- 
ment prediction means (indicated as a whole by 
"Mc" in the abovementioned Figure 1) which may 
be situated in series therewith. The encoder also 
comprises the reduction means, coupled to the 

10 input, for reducing the received digital signal, the 
second data processing means, coupled to the 
reduction means, for generating a second coded 
digital signal, and the second encoder feedback 
means for feeding back at least a section of the 

16 second data processing means in order to make 
the coding proceed more efficiently. The second 
encoder feedback means comprise the second en- 
coder memory means and second encoder move- 
ment prediction means, which may be situated in 

20 series therewith, and are coupled, via the encoder 
coupling means, to the first encoder feedback 
means (the reduction means, second data process- 
ing means and second encoder primary means are 
not shown directly in the abovementioned Figure 1 

26 but are evident therefrom, in a manner known to 
the person skilled in the art, because they are 
indicated symbolically by "MPEG-1"). The encoder 
coupling means comprise the encoder prediction 
means (indicated by "Uc" in the abovementioned 

30 Figure 1). 

Such a system, provided with first and second 
data processing means, is, as it were, made up of 
two layers: the first data processing means gen- 
erate the first coded digital signal, which has the 

35 highest resolution because said signal is obtained 
by processing the received digital signal, and the 
second data processing means generate the sec- 
ond coded digital signal, which has the lowest 
resolution because said signal is obtained by pro- 

40 cessing the received digital signal reduced by the 
reduction means. The two signals are then trans- 
mitted by means of multiplexing and demultiplex- 
ing to the decoder, which is based on layered 
decoding and which, in the case of coding on the 

45 basis of high resolution, uses both signals and, in 
the case of decoding on the basis of low resolution, 
uses only the second coded digital signal. The 
decoder comprises the first data reprocessing 
means for processing a first coded digital signal 

50 (indicated by, respectively, "Q"'", "T"^" and by 
"MPEG-2 bits" in the abovementioned Figure 2), 
the first decoder memory means (and decoder 
movement compensation means which may be sit- 
uated in series therewith, indicated as a whole by 

55 "Mc" in the abovementioned Figure 2), which are 
coupled to the first data reprocessing means, the 
second data reprocessing means for processing a 
second coded digital signal (indicated by, respec- 
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tively, "Q-^", "T-^" and by "MPEG-I bits" in the 
abovementioned Figure 2), and the second de- 
coder mennory nneans (and second decoder move- 
ment compensation means which may be situated 
in series therewith, Indicated as a whole by "Mc" in 
the abovementioned Figure 2) which are coupled to 
the second data reprocessing means and, via the 
decoder coupling means, to the first decoder mem- 
ory means. The decoder coupling means comprise 
the decoder prediction means (indicated by "Uc" 
in the abovementioned Figure 2). 

The known system has the disadvantage that it 
exhibits a certain inefficiency In coding and decod- 
ing If the layer which codes with high resolution 
codes a signal which corresponds, for example, to 
an HDTV picture and the layer which codes with 
low resolution codes a signal corresponding to a 
conventional tv picture derived from the HDTV pic- 
ture. 

B Summary of the invention 

The object of the invention is to provide a 
system of the type mentioned in the preamble 
which codes and decodes more efficiently in the 
case of the given, different tv standards. 

For this purpose, the system according to the 
invention has the characteristic that the encoder is 
provided with encoder means, coupled to the input, 

- for deriving a position code from the digital 
signal, 

- for comparing the position code with at least 
one adjustable code, and 

- for decoupling, subject to a comparison re- 
sult, the second encoder feedback means 
and the first encoder feedback means. 

According to an HDTV (high definition televi- 
sion) standard, an HDTV picture which, prior to 
coding, corresponds to the digital signal to be 
coded and, after coding, corresponds to the first 
coded digital signal (the high-resolution signal) 
should have dimensions with a ratio of 16:9, while a 
conventional picture which, prior to coding, cor- 
responds to the reduced digital signal to be coded 
and, after coding corresponds to the second coded 
digital signal (the low-resolution signal) should have 
dimensions with a ratio of 4:3. Under these con- 
ditions, the surface area of the HDTV picture will 
generally exceed the surface area of the conven- 
tional picture, in which case the HDTV picture can 
be divided up into a section which corresponds to 
the conventional picture (the corresponding sec- 
tion) and into a section which exceeds (the exceed- 
ing section). Whether a picture element is situated 
in the corresponding section or in the exceeding 
section of the HDTV picture is determined by de- 
riving, with the encoder means, the position code 
from the digital signal to be coded and comparing 



it with the adjustable code. If the picture element is 
situated in the corresponding section, the layer 
which codes with low resolution should be coupled 
to the layer which codes with high resolution in 

5 order to be able to serve, if necessary, as a predic- 
tion in the latter because both layers code cor- 
responding picture elements with different resolu- 
tion and prediction is therefore among the possibili- 
ties. If the picture element is situated in the ex- 

70 ceeding section of the HDTV picture, the layer 
which codes with low resolution must not be coup- 
led to the layer which couples with high resolution 
because the layer which codes with low resolution 
must not serve as a prediction in the latter (since 

75 the picture element is situated outside the actual 
working region of the layer which codes with low 
resolution and prediction is therefore not among 
the possibilities), and this is achieved by decoupl- 
ing the second encoder feedback means from the 

20 first encoder feedback means. 

In this connection, the decoupling should be 
interpreted with a very wide meaning. If the system 
is, for example, furthermore constructed as de- 
scribed in Dutch Patent Application No. 9200499 

25 (priority date 17th March 1992), which is not yet 
laid open, in which the encoder prediction means 
are connected both to an input of the first data 
processing means and to an input of the first 
encoder feedback means in order to prevent the 

30 presence of nested loops in the decoder, the de- 
coupling could be achieved by providing, in a cou- 
pling, a switch which is set to the nonconducting 
state, in which case the decoder would also have 
to be provided with such a switch. The decoupling 

35 could also be achieved by providing, in a coupling, 
a logic circuit which, in response to a control sig- 
nal, converts a signal (an arbitrary number), origi- 
nating from the layer which codes with low resolu- 
tion and intended for the layer which codes with 

40 low resolution, into a nneaningless signal (for exam- 
ple, the number zero). In this case, the decoder 
would also have to be provided with such a logic 
circuit. 

If the position code comprises an (x,y) coordi- 
45 nate and a corner point of the HDTV picture co- 
incides with a corner point of the conventional tv 
picture, it is sufficient to compare said position 
code with one adjustable code (another (x,y) co- 
ordinate) in order to be able to determine if a 
50 picture element is situated in a corresponding or 
exceeding section. If the two corner points do not 
coincide, at least two adjustable codes will be 
necessary. If the position code comprises a single 
number, the manner of numbering picture elements 
55 (for example from left to right and then from top to 
bottom) to be distinguished in the HDTV picture 
and whether both corner points do or do not co- 
incide determine with how many adjustable codes 
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comparison should be mad 
is adjusted in the case of th 
by determining with a joysti 
HDTV picture should be vi 
picture. 

The increase in the ef 
and decoding of the system 
tion becomes possible beca 
picture elements situated ir 
in coding with low resolutic 
coding with high resolution 
coded with low resolution. 

The invention is based 
digital signal representing ai 
coded with high resolution 
therefrom and representing 
smaller picture, Is to be co( 
it Is inefficient to code thed 
the whole surface area of 
low resolution and to use it 
with high resolution. 

A first embodiment of tf 
the invention has the dia 
coder coupling means are . 
switching means, controll; ' 
means, of which a main cc 
Input, of which a first switc 
the first encoder memory 
second switch contact Is ( 
encoder memory means via 
means, the decoder coupr' 
vided with decoder switchi 
via the decoder means, of ^ * 
coupled to the first data r . 
which a first switch contaci 
decoder memory means a 
switch contact Is coupled i 
memory means via the dec( ' 

In this case, the encode 
the decoder switching me 
example, as switch-over trn 
main contact Is connected tl 
switch contaci or to the se- 
subject to a "system contr 
of the encoder switching 
through to the first switch 
high-resolution picture ston 
memory means is used in c 
high-resolution picture. If, t 
controller", the main contac 
ing means is connected 1 
switch contact, the current I 
used to predict the new higt 
information needed for ttiis 
the "system controller", I 
means of multiplexing and 
decoder so that the decodt 
In a synchronous state vrith 



* r biG code means. Both in the encoder and In the decoder, the 

ample, two layers can be decoupled by connecting the 

'." jt't of the main contact of the switching means through to the 

n^ontional first switch contact. For this purpose, the encoder 
5 means should be able to influence the control 

' coding information originating from the "system control - 

-.;:0 inven- ler", for example via a logic circuit to be sited 

. Ignores between the "system controller" and the encoder 

J section switching means. In this connection, it Is also con- 

:\;'ing the w ceivable that the "system controller" comprises the 

of signals encoder means. 

The encoder switching means and the decoder 

' '. [tiat if a switching means may furthermore be designed as 

■ 0 is to be means for adjusting a ratio of signals present at the 

- derived 75 first switch contact and second switch contact and 

'■onal and for then combining the two signals adjusted in this 

solution, way. As described In Dutch Patent Application No. 

' :!'vOn over 9201594 (priority date 14 September 1992), which 

'•:Lure with has not yet been laid open, the switching means 

'.' 0 coding 20 can be equipped for multiplying the signal present 
at the first switch contact by the value x and for 

coi ding to multiplying the signal present at the second switch 

■[ Ihe en- contact by the value 1-x, where O^x^l. In this case, 

: encoder it Is also possible, by setting x = 1, to achieve the 

; oncoder 25 result that the two layers In the encoder and the 

•od to the decoder are decoupled. 

• upled to A second embodiment of the system according 

: > ./hich a to the invention has the characteristic that the de- 

' 0 second coder is provided with decoder means 

.::odiction 30 - for deriving the position code from a coded 

.Oiog pro- digital signal and for receiving the adjustable 

. uollable code, 

Ofitact is - for comparing the position code with the ad- 

:ans, of justable code, and 

; :< ihe first 35 - for decoupling, subject to a comparison re- 

0 second suit, the second decoder memory means and 
) decoder the first decoder memory means. 

means. Whether a picture element is situated in the 

,' i-jns and corresponding section or in the exceeding section 

■jned, for 40 of the HDTV picture Is determined by deriving, with 

\ j say the the decoder means, the position code from a cod- 

[0 ihe first ed digital signal and comparing it with the adjust- 

, :,)[act. If, able code. If the picture element is situated In the 

contact corresponding section, the layer which decodes 

: : rinected 45 with low resolution should be coupled to the layer 

: fjrevious which decodes with high resolution in order to be 

A oncoder able, if necessary, to serve as a prediction in the 

1 Ihe new latter because the two layers decode correspond- 
o "system ing picture elements with different resolution and 
:!:r switch- 50 prediction is therefore among the possibilities. If 

second the picture element is situated in the exceeding 

' picture Is section of the HDTV picture, the layer which 60- 

! : iure. The codes with low resolution must not be coupled to 

O'.es from the layer which decodes with high resolution be- 

. iued by 65 cause the layer which decodes with low resolution 

■("ig to the cannot serve as a prediction in the latter (since the 

cans are picture element is situated outside the actual work- 

c^vvitching ing region of the layer which decodes with low 
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resolution and prediction is now therefore not 
among the possibilities), and this Is achieved by 
decoupling the second decoder nnennory means 
from the first decoder memory means. 

This achieves a maximum improvement in the 
efficiency of the coding and decoding by the sys- 
tem because now only the adjustable code has to 
be transmitted from the encoder to the decoder by 
means of the multiplexer and the demultiplexer and 
because, as a result, the encoder and the decoder 
have to take account of the difference in surface 
area between the HDTV picture and the conven- 
tional picture only as a function of the derived 
position code and the adjustable code. If the de- 
coder is not provided with the decoder means, the 
encoder will also have to transmit all kinds of 
elaborate control information so that the decoding 
process nevertheless proceeds synchronously in 
the various layers of the decoder (the decoding of 
signals corresponding to pictures having different 
surface areas will, after all, result in asynchronism 
between the layers). If the decoder is provided with 
decoder means, internal synchronism is automati- 
cally ensured without the elaborate control informa- 
tion having to be transmitted at the same time, and 
this has a positive effect on the efficiency. 

The invention furthermore relates to an en- 
coder for use in the system according to the inven- 
tion, comprising 

- an input for receiving the digital signal, 

- first data processing means, coupled to the 
input, for generating a first coded digital sig- 
nal, 

- first encoder feedback means for feeding 
back at least a section of the first data pro- 
cessing means, which first encoder feedback 
means comprise first encoder memory 
means, 

- reduction means, coupled to the input, for 
reducing the received digital signal, 

- second data processing means, coupled to 
the reduction means, for generating a second 
coded digital signal, 

- second encoder feedback means for feeding 
back at least a section of the second data 
processing means, which second encoder 
feedback means comprise second encoder 
memory means, and 

- encoder coupling means for coupling the 
second encoder feedback means to the first 
encoder feedback means, which encoder 
coupling means comprise encoder prediction 
means. 

The encoder according to the invention has the 
characteristic that the encoder is provided with 
encoder means, coupled to the input, 

- for deriving a position code from the digital 
signal, 



- for comparing the position code with at least 
one adjustable code, and 

- for decoupling, subject to a comparison re- 
sult, the second encoder feedback means 

6 and the first encoder feedback means. 

A first embodiment of the encoder according to 
the invention has the characteristic that the en- 
coder coupling means are provided with encoder 
switching means, controllable via the encoder 

10 means, of which a main contact Is coupled to the 
input, of which a first switch contact is coupled to 
the first encoder memory means and of which a 
second switch contact is coupled to the second 
encoder memory means via the encoder prediction 

15 means. 

The Invention yet furthermore relates to a de- 
coder for use in the system according to the inven- 
tion, comprising 

- first data reprocessing means for processing 
20 a first coded digital signal, 

- first decoder memory means which are coup- 
led to the first data reprocessing means, 

- second data reprocessing means for process- 
ing a second coded digital signal, 

25 - second decoder memory means which are 
coupled to the second data reprocessing 
means, and 

- decoder coupling means for coupling the 
second decoder memory means to the first 

30 decoder memory means, which decoder cou- 

pling means comprise decoder prediction 
means. 

The decoder according to the invention has the 
characteristic that the decoder Is provided with 
36 decoder means 

- for deriving the position code from a coded 
digital signal and for receiving the adjustable 
code, 

- for comparing the position code with the ad- 
40 justable code, and 

- for decoupling, subject to a comparison re- 
sult, the second decoder memory means and 
the first decoder memory means. 

A first embodiment of the decoder according to 
45 the invention has the characteristic that the de- 
coder coupling means are provided with decoder 
switching means, controllable via the decoder 
means, of which a main contact Is coupled to the 
first data reprocessing means, of which a first 
50 switch contact Is coupled to the first decoder mem- 
ory means and of which a second switch contact Is 
coupled to the second decoder memory means via 
the decoder prediction means. 

55 C Reference 

■ "Coded representation of picture and audio 
Information", 
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"TMI Compatibility Experiments", by I. Parke, 
ISO-IEC/JTC1/SC29/WG11, MPEG92/291 

D Exemplary embodiment 

The invention will be explained in greater detail 
by reference to an exemplary embodiment shown 
in the figures. In the figures: 

Figure 1 shows an encoder according to the 

invention, 

Figure 2 shows a decoder according to the 
invention, and 

Figure 3 shows an HDTV picture and a conven- 
tional picture provided with position codes. 
The encoder shown in Figure 1 is made up of 
two layers. The first layer (10-21) codes signals on 
the basis of the highest resolution and the second 
layer (30-41) codes signals on the basis of the 
lowest resolution. 

The first layer comprises first data processing 
means 10, which are made up of a series circuit of 
transforming means 11, quantizing means 12 and 
coding means 13 and of a series connection, coup- 
led to a branching point situated between the quan- 
titizing means 12 and coding means 13, of inverse 
quantizing means 14 and inverse transforming 
means 15. An input of the transforming means 11 
forms an input of data processing means 10, which 
is coupled to an output of subtraction circuit 16. An 
output of coding means 13 forms a coding output 
of data processing means 10 for generating a first 
coded digital signal on the basis of the high resolu- 
tion, which coding output is coupled to a first input 
of a multiplexer 6. An output of inverse transform- 
ing means 15 forms a feedback output of data 
processing means 10 for (at least partially) feeding 
back said data processing means 10, which feed- 
back output is coupled to a first (plus) input of 
addition circuit 19. An output of addition circuit 19 
is coupled to an input of first encoder memory 
means 20. These are bidirectionally coupled to first 
encoder movement prediction means 21, of which 
a vector output for generating a first vector signal is 
coupled to a second input of multiplexer 6. An 
input of encoder movement prediction means 21 is 
coupled to an input 1 of the encoder, which input 1 
is furthermore coupled to a first (plus) input of 
subtraction circuit 16. A second (minus) input of 
the latter is coupled to a second (plus) input of 
addition circuit 19 and to an output (main contact) 
of encoder switching means 7, of which a first input 
(first switch contact) is coupled to a further output 
of encoder movement prediction means 21 . A con- 
trol input of encoder switching means 7 is coupled 
to a fifth input of multiplexer 6 and to an output of a 
system controller 8, of which an input is coupled to 
the input 1 . The system controller 8 transmits an x- 
signal which represents the value of x to the en- 



coder switching means 7 and to the multiplexer 6, 
which then transmits the x-signal to the decoder in 
multiplexed form. Encoder switching means 7 are 
equipped for adjusting the ratio of the signals 

5 present at the first input and second input by 
multiplying the signal present at the first input 
(originating from the first encoder movement pre- 
diction means 21) by the value x and by multiply- 
ing the signal present at the second input (originat- 

10 ing from the encoder prediction means 3) by the 
value 1-x and by then adding the two signals 
obtained in this way. For the value x it is the case 
that O^x^l, which value is determined by the sys- 
tem controller 8, in a manner to be considered 

76 later, and is adjusted by means of the control input 
of the encoder switching means 7. The first en- 
coder memory means 20 and the first encoder 
movement prediction means 21 together form the 
first encoder feedback means. 

20 The second layer comprises second data pro- 
cessing means 30, which are made up of a series 
connection of transforming means 31, quantizing 
means 32 and coding means 33 and of a series 
connection, coupled to a branching point situated 

25 between the quantizing means 32 and coding 
means 33, of inverse quantizing means 34 and 
inverse transforming means 35. An input of trans- 
forming means 31 forms an input of data process- 
ing means 30, which is coupled to an output of 

30 subtraction circuit 36. An output of coding means 
33 forms a coding output of data processing means 
30 for generating a second coded digital signal on 
the basis of the low resolution, which coding output 
is coupled to a third input of a multiplexer 6. An 

35 output of inverse transforming means 55 forms a 
feedback output of data processing means 30 for 
(at least partially) feeding back said data process- 
ing means 30, which feedback output is coupled to 
a first (plus) Input of addition circuit 39. An output 

40 of addition circuit 39 is coupled to an input of 
second encoder memory means 40. These are 
bidirectionally coupled to second encoder move- 
ment prediction means 41 , of which a vector output 
for generating a second vector signal is coupled to 

45 a fourth input of multiplexer 6. An input of encoder 
movement prediction means 41 is coupled to an 
output of reduction means 2 for reducing the re- 
ceived signal, which output is furthermore coupled 
to a first (plus) input of subtraction circuit 36. A 

50 second (minus) input of the latter is coupled to a 
further output of encoder movement prediction 
means 41, which further output is furthermore 
coupled to a second (plus) input of addition circuit 
39. Reduction means 2, of which an input is coup- 

55 led to the input 1 of the encoder, comprise filtering 
means and subsampling means. The output of ad- 
dition circuit 39 is furthermore coupled to an input 
of encoder prediction means 3 for coupling data 
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processing means 30 to data processing means 
10. An output of encoder prediction means 3 is 
coupled to a second input (a second switch con- 
tact) of encoder switching means 7. Encoder pre- 
diction means 3 comprise interpolating means and 
upsampling means. At the same time, the second 
encoder memory means 40 and the second en- 
coder movement prediction means 41 together 
form the second encoder feedback means. 

The operation of the encoder shown in Figure 
1 is as follows. The digital signal to be coded is 
presented to input 1 as a bit stream, a predeter- 
mined number of bits in each case forming a 
picture element (pixel or pel). Assuming that the 
encoder switching means are adjusted with x = 1 
and that the content of the first encoder memory 
means 20 is vacant, a first group of pels reaches 
the data processing means 10 via subtraction cir- 
cuit 16. The transforming means 11 carry out, for 
example, a discrete cosine transformation on the 
group of pairs, which determines the associated 
coefficient for each frequency component. The 
quantizing means 12 quantize the signal obtained. 
The quantized signal is then coded by coding 
means 13, for example on the basis of a two- 
dimensional table which generates new codewords 
which, on average, have a shorter length than the 
incoming words, and fed to multiplexer 6. This 
transformed, quantized and coded first group of 
pels consequently forms the first section of the 
signal coded on the basis of the high resolution. 
After being transformed and quantized, the first 
groups of pels is inversely quantized by inverse 
quantizing means 14 and inversely transformed by 
inverse transforming means 15, and stored, via 
addition circuit 19, in a first location in encoder 
memory means 20. A second group of pels tra- 
verses the same route as the first group of pels, 
undergoes the same processing and is stored in a 
second location in encoder memory means 20, etc. 
until all the groups of pels of one complete picture 
(the first picture) have been stored. 

The first group of pels of the next (second) 
picture is then presented at input 1 and fed to 
encoder movement prediction means 21 which, on 
the basis of the preceding (first) picture stored in 
encoder memory means 20, investigate whether 
there is a possibility of a certain movement taking 
place. If this is so, said movement is fed in the 
form of the first vector signal to multiplexer 6. At 
the same time, encoder memory means 20 gen- 
erate the first group of pels of the preceding (first) 
picture, which first group of pels is subtracted, via 
encoder movement prediction means 21 and via 
encoder switching means 7 (because the latter are 
adjusted with x = 1) from the first group of pels of 
the (second) picture to be coded by means of 
subtraction circuit 16. Because the difference be- 



tween the first group of pels of the second picture 
and the first group of pels of the first picture is then 
presented to data processing means 10, the coding 
proceeds appreciably more efficiently. The fact that 

5 the encoder prediction means take account of pos- 
sible movements in the picture content of the sub- 
sequent pictures increases the efficiency even fur- 
ther. Instead of vectors, of course, other prediction 
parameters determined on the basis of other pre- 

70 diction methods may also be transmitted. 

What is described above is the operation of the 
encoder as regards the first layer, which is con- 
structed around data processing means 10, the 
encoder switching means being adjusted with x = 1 . 

75 The operation as regards the second layer, con- 
structed around data processing means 30, is in 
principle identical (given the adjustment x = 1 ), with 
the exception of the following. Data processing 
means 30 receive, via subtraction circuit 36, the 

20 received signal, which has been reduced via reduc- 
tion means 2 and which has a lower resolution than 
the signal presented at input 1 as a consequence 
of the filtering and subsampting. The coded signal 
generated by data processing means 30 is con- 

25 sequently coded on the basis of a lower resolution 
(the low resolution). 

If the encoder means are adjusted with x = l, 
the first group of pels of the preceding (first) pic- 
ture is subtracted from the first group of pels of the 

30 (second) picture to be coded by means of subtrac- 
tion circuit 16. As a result, a section of the stored 
preceding, high-resolution picture is used in order 
to predict a section of the new high-resolution 
picture to be coded. If the section of the stored 

35 preceding, high-resolution picture only slightly re- 
sembles, or does not resemble, the corresponding 
section of the new high-resolution picture to be 
coded, a decision may be made to base the pre- 
diction on a section of the new low-resolution pic- 

40 ture. In that case, the encoder switching means 
should be adjusted with x = 0. Although the effi- 
ciency of the data processing means was in- 
creased in the case where x = 1 because it was 
only necessary to code the difference between the 

45 first group of pels of the second picture and the 
first group of pels of the first picture, in the case 
where x = 0, the efficiency of the data processing 
means 10 is also increased because, as a con- 
sequence of the coupling of the second layer to the 

50 first layer via encoder prediction means 3 a group 
of pels, coarsely coded in the second layer, only 
have to be coded still more finely in the first layer. 
The interpolating and upsampling by encoder pre- 
diction means 3 is necessary because of the dif- 

55 ferent levels of resolution between the two layers. 

The two types of predictions are combined if a 
value between 0 and 1 is chosen for x. If x = i, the 
two types of predictions are of equal weight. If x<^. 
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the prediction based on the current low-resoiution 
picture weighs nnore heavily, and if x>i, the predic- 
tion based on the preceding, high-resolution picture 
weighs more heavily. With a correctly chosen value 
of X, it appears possible to achieve 3 dB gain in the 
prediction with respect to a system in which the 
encoder switching means are designed as a 
change-over switch (that is to say with only the 
possibility of x = 0 or x = 1). The optimum value of x 
is determined by the system controller 8, which 
investigates, for example, for every possible value 
of X how many bits are needed at the coding 
output of the data processing means 10 in order to 
reproduce a coded section of a picture. In this 
case, a further input (not shown in Figure 1) of the 
system controller 8 is coupled to the output of data 
processing means 10. The value of x which re- 
quires the fewest bits in this case forms the opti- 
mum value. The further input, not shown in Figure 
1, of the system controller 8 could also be coupled 
to the output of subtraction circuit 16, the square of 
the result signal (difference signal or error signal) 
present at this output having to be calculated for 
every value of x. The value of x which yields the 
smallest error then forms the optimum value. 

In the encoder shown in Figure 1, the system 
controller 8 comprises the encoder means 

- for deriving a position code from the digital 
signal. 

- for comparing the position code with at least 
one adjustable code, and 

- for decoupling, subject to a comparison re- 
sult, the second encoder feedback means 
and the first encoder feedback means. 

For this purpose, the encoder means are coup- 
led to the input 1 and they are provided, for exam- 
ple, with a counter which derives the position code 
from the bit stream to be coded. Furthermore, the 
encoder means are coupled, for example, to a 
joystick which is operated by a human being (in 
order to determine therewith which section of the 
16:9 HDTV picture should be coded with lower 
resolution as 4:3 conventional picture) and which 
generates the adjustable code which is fed to the 
encoder means. Furthermore, the encoder means 
are provided, for example, with a comparator for 
comparing position code derived by means of us- 
ing the counter with the adjustable code originating 
from the joystick. Depending on the comparison 
result, the comparator generates, for example, a 
logic one if the respective picture element (referred 
to the position code) is situated outside the con- 
ventional picture (or in the exceeding section of the 
HDTV picture) and the comparator generates, for 
example, a logic zero if the respective picture 
element (referred to the position code) is situated 
inside the conventional picture (or in the corre- 
sponding section of the HDTV picture). If the output 



signal of the comparator is fed to a first input of an 
OR gate and the x-signal to a second input thereof, 
the x-signal appears at the output of the OR gate if 
the respective picture element is in the correspond- 

5 ing section and a logic one appears at the output if 
the respective picture element is situated in the 
exceeding section. Feeding the output signal from 
the OR gate as a new x-signal to the encoder 
switching means 7 achieves the result that, if the 

10 respective picture element is situated in the ex- 
ceeding section, the encoder switching means are 
adjusted with x = 1 (regardless of the value of x 
generated by the system controller 8), as a result 
of which the first and second encoder feedback 

75 means are decoupled. The same is true, of course, 
for encoder switching means which are designed 
as switch-over means and, consequently, only have 
the values x = 0 and x = 1 . 

If the system is constructed as described in 

20 Dutch Patent Application No. 9200499 (priority date 
17 March 1992), which is not yet laid open, in 
which the encoder prediction means 3 are con- 
nected both to an input of the first data processing 
means 10 and to an input of the first encoder 

25 memory means 20 in order to prevent nested loops 
Jn the decoder and in which the encoder switching 
means 7 are then absent, the decoupling could be 
achieved by providing, in a coupling (for example 
between encoder memory means 40 and encoder 

30 prediction means 3), a switch which is set to the 
nonconducting state. The decoupling can also be 
achieved by providing, in a coupling, a logic circuit 
which, in response to a control signal, converts a 
signal (an arbitrary number) which originates from 

35 the layer which codes with low resolution and is 
intended for the layer which codes with high reso- 
lution into a meaningless signal (for example the 
number zero). Setting the switch to the nonconduc- 
ting state can in this case be controlled by the 

40 abovementioned comparator which could also fur- 
thermore supply the control signal. 

The encoder should not comprise less than two 
layers, in which case the coded signal having the 
high resolution is suitable, for example, for re- 

45 producing so-called high-definition television pic- 
tures and the coded signal having the low resolu- 
tion is suitable for reproducing standard television 
pictures. If the encoder comprises three layers, 
signals could be coded with the third layer for 

60 reproducing, for example, pictures for a so-called 
videophone, in which a yet lower resolution is suffi- 
cient. 

The decoder shown in Figure 2 comprises a 
demultiplexer 70, having an input for receiving the 
65 multiplexed signal which originates from the en- 
coder and which comprises the first coded digital 
signal, which has the highest resolution, the first 
vector signal, the second coded digital signal. 
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coding on the first coded digital signal, for example 
on the basis of a table, they then carry out, via 
inverse quantizing means 82, an inverse quantizing 
and after that they carry out, via inverse transform- 

5 ing means, an inverse transformation, for example 
an inverse discrete cosine transformation. Second 
data reprocessing means 79 carry out, via inverse 
coding means 71 , ah inverse coding on the second 
coded digital signal, for example on the basis of a 

10 table, they then carry out, via inverse quantizing 
means 72, an inverse transformation, and after that 
they carry out, via inverse transforming means 73, 
an inverse transformation, for example an inverse 
discrete cosine transformation. The signal gener- 

75 ated by second data reprocessing means 79 has 
the low resolution and forms the difference be- 
tween a particular group of pels of a particular 
picture and a particular group of pels of a picture 
prior thereto. With the aid of addition circuit 74, 

20 second decoder memory means 75 and second 
decoder movement compensation means 76, the 
particular group of pels of the particular picture 
then appears at the second (low-resolution) output 
of the decoder. This signal is interpolated and 

25 upsampled with the aid of decoder prediction 
means 77, after which it is suitable to be fed to the 
second input of decoder switching means 87. 

The signal generated by first data reprocessing 
means 89 has the high resolution and forms the 

30 difference between a particular group of pels of a 
particular picture and a particular group of pels of a 
picture prior thereto. With the aid of addition circuit 
84, first decoder memory means 85, first decoder 
movement compensation means 86 and decoder 

35 switching means 87, the particular group of pels of 
the particular picture then appears at the first (high- 
resolution) output of the decoder. 

Decoder switching means 87 receive the x- 
signal via the fifth output of demultiplexer 70 be- 

40 cause, as long as they are detecting a position 
code which implies that the respective picture ele- 
ment is situated in the corresponding section of the 
HDTV picture, the decoder means 90 allow said x- 
signal to pass unaltered. As soon as decoder 

45 means 90 detect a position code which implies that 
the respective picture element is situated in the 
exceeding section, they change the x-signal to 
x = 1, as a result of which both layers in the de- 
coder are decoupled. The derivation of the position 

50 code, the comparison of said position code with the 
adjustable code and the intervention in the x-signal 
take place in the same way as described for the 
encoder means, and the alternatives mentioned in 
this connection also apply to the decoder means 

55 90. 

The use of multiplexer 6 and demultiplexer 70 
is, of course, only one embodiment. Thus, it is 
conceivable, for example, in video recorders that 
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the transmission of the signals from the encoder to 
the decoder takes place via normal individual con- 
nections, and there are, furthermore, methods other 
than multiplexing and demultiplexing by which dif- 
ferent signals can also be transferred (such as 
modulation and demodulation techniques). Further- 
more, separate multiplexers could be used for each 
layer in the encoder and separate demultiplexers 
for each layer in the decoder. 

The HDTV picture (16:9) shown in Figure 3 is 
made up of 32 areas, with a two-dimensional posi- 
tion code for each area, 1,1 at the top left, 4,1 at 
the bottom left, 1 ,8 at the top right and 4,8 at the 
bottom right. The conventional picture (4:3) is 
made up of 24 areas, with a two-dimensional posi- 
tion code for each area, 1 ,2 at the top left, 4,2 at 
the bottom left, 1 ,7 at the top right and 4,7 at the 
bottom right. In this diagram, the corresponding 
section is represented by the position codes 
1,2....1,7 and 2,2....2,7 and 3.2..,.3,7 and 4,2....4,7. 
The exceeding section is represented by the posi- 
tion codes 1,1 and 1,8 and 2,1 and 2,8 and 3,1 and 
3,8 and 4,1 and 4,8. By fixing the position of the 
conventional picture with respect to the HDTV pic- 
ture by means of a joystick and choosing as ad- 
justable codes, for example, the top-left corner and 
the bottom-right corner of the conventional picture, 
it becomes possible to determine for any area 
whether it is situated in the corresponding section 
or in the exceeding section by comparing the posi- 
tion code associated therewith with the two adjust- 
able codes. If a corner point of the conventional 
picture coincides with a corner point of the HDTV 
picture, it is even sufficient to compare the position 
code with one adjustable code. Furthermore, posi- 
tion codes other than the two-dimensional codes 
mentioned here, such as, for example, one-dimen- 
sional numbers, are, of course, conceivable, in 
which case a position code will generally have to 
be compared with various adjustable codes. 

It should be pointed out that the 8x4 = 32 areas 
(ratio 8:4 or 16:8) shown in Figure 3 are insufficient 
to image an HDTV picture correctly (with the cor- 
rect ratios). For this purpose, not less than 
16x9 = 144 areas would, after all, be necessary. In 
that case, the conventional picture would comprise 
12x9 = 108 areas, whereas this picture comprises 
6x4 = 24 areas (ratio 3:2 or 6:4) in Figure 3. Figure 
3 shows, however, only an arbitrary design, which 
has been kept as simple as possible. Furthermore, 
Figure 3 indicates that the system according to the 
invention, and the encoder and the decoder ac- 
cording to the invention, must not be interpreted as 
restricted: the system, the encoder and the de- 
coder are, in principle, suitable for coding and 
decoding any high-resolution signal (which corre- 
sponds to a picture having first dimensions) and 
any low-resolution signal derived therefrom (which 



corresponds to a picture having different dimen- 
sions). 

Claims 

6 

1. System comprising at least one encoder for 
coding a digital signal and at least one de- 
coder for decoding a coded digital signal, 
which encoder is provided with 
10 - an input for receiving the digital signal, 

- first data processing means, coupled to 
the input, for generating a first coded 
digital signal, 

- first encoder feedback means for feeding 
75 back at least a section of the first data 

processing means, which first encoder 
feedback means comprise first encoder 
memory means, 

- reduction means, coupled to the input, 
20 for reducing the received digital signal, 

- second data processing means, coupled 
to the reduction means, for generating a 
second coded digital signal, 

- second encoder feedback means for 
25 feeding back at least a section of the 

second data processing means, which 
second encoder feedback means com- 
prise second encoder memory means, 
and 

30 - encoder coupling means for coupling the 

second encoder feedback means to the 
first encoder feedback means, which en- 
coder coupling means comprise encoder 
prediction means, 

35 and which decoder is provided with 

- first data reprocessing means for pro- 
cessing a first coded digital signal, 

- first decoder memory means, which are 
coupled to the first data reprocessing 

40 means, 

- second data reprocessing means for pro- 
cessing a second coded digital signal, 

- second decoder memory means, which 
are coupled to the second data reproces- 

45 sing means, and 

- decoder coupling means for coupling the 
second decoder memory means to the 
first decoder memory means, which de- 
coder coupling means comprise decoder 

60 prediction means, 

characterized in that the encoder is pro- 
vided with encoder means, coupled to 
the input, 

65 - for deriving a position code from the 

digital signal, 

- for comparing the position code with at 
least one adjustable code, and 
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- for decoupling, subject to a comparison 
result, the second encoder feedback 
means and the first encoder feedback 
means. 

6 

2. System according to Claim 1 , characterized in 
that the encoder coupling means are provided 
with encoder switching means, controllable via 
the encoder means, of which a main contact is 
coupled to the input, of which a first switch io 
contact is coupled to the first encoder memory 
means and of which a second switch contact is 
coupled to the second encoder memory 
means via the encoder prediction means, the 
decoder coupling means being provided with 75 
decoder switching means, controllable via the 
decoder means, of which a main contact is 
coupled to the first data reprocessing means, 

of which a first switch contact is coupled to the 
first decoder memory means and of which a 20 
second switch contact is coupled to the sec- 
ond decoder memory means via the decoder 
prediction means. 

3. System according to Claim 1 or 2, character- 25 
ized In that the decoder is provided with de- 
coder means 

- for deriving the position code from a 
coded digital signal and for receiving at 
least one adjustable code, 30 

- for comparing the position code with the 
adjustable code, and 

- for decoupling, subject to a comparison 
result, the second decoder memory 
means and the first decoder memory 35 
means. 

4. Encoder for coding a digital signal for use in 
the system according to Claim 1, comprising 

- an input for receiving the digital signal, 40 

- first data processing means, coupled to 
the input, for generating a first coded 
digital signal. 

- first encoder feedback means for feeding 
back at least a section of the first data 45 
processing means, which first encoder 
feedback means comprise first encoder 
memory means, 

- reduction means, coupled to the input, 

for reducing the received digital signal, 50 

- second data processing means, coupled 
to the reduction means, for generating a 
second coded digital signal, 

- second encoder feedback means for 
feeding back at least a section of the 55 
second data processing means, which 
second encoder feedback means com- 
prise second encoder memory means. 



and 

- encoder coupling means for coupling the 
second encoder feedback means to the 
first encoder feedback means, which en- 
coder feedback means comprise encoder 
prediction means, characterized in that 
the encoder is provided with encoder 
means, coupled to the input, 

- for deriving a position code from the 
digital signal, 

- for comparing the position code with at 
least one adjustable code, and 

- for decoupling, subject to a comparison 
result, the second encoder feedback 
means and the first encoder feedback 
means. 

5. Encoder according to Claim 4, characterized in 
that the encoder coupling means are provided 
with encoder switching means, controllable via 
the encoder means, of which a main contact is 
coupled to the input, of which a first switch 
contact is coupled to the first encoder memory 
means and of which a second switch contact is 
coupled to the second encoder memory 
means via the encoder prediction means. 

6. Decoder for decoding a coded digital signal for 
use in the system according to Claim 1 , com- 
prising 

- first data reprocessing means for pro- 
cessing a first coded digital signal, 

- first decoder memory means, which are 
coupled to the first data reprocessing 
means, 

- second data reprocessing means for pro- 
cessing a second coded digital signal, 

- second decoder memory means, which 
are coupled to the second data reproces- 
sing means, and 

- decoder coupling means for coupling the 
second decoder memory means to the 
first decoder memory means, which de- 
coder coupling means comprise decoder 
prediction means, 

characterized in that the decoder is pro- 
vided with decoder means, 

- for deriving the position code from a 
coded digital signal and for receiving at 
least one adjustable code, 

- for comparing the position code with the 
adjustable code, and 

- for decoupling, subject to a comparison 
result, the second decoder memory 
means and the first decoder memory 
means. 
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7. Decoder according to Claim 7, characterized in 
that the decoder coupling nneans are provided 
with decoder switching nneans, controllable via 
the decoder nneans, of which a nnain contact is 
coupled to the first data reprocessing means, 
of which a first switch contact is coupled to the 
first decoder memory means and of which a 
second switch contact is coupled to the sec- 
ond decoder memory means via the decoder 
prediction means. 
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